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The Birst Generalized SpecMe-Noise Pattern Redttctton Method 
Of The Present Inventioii 

■ I I I I ■ " """" I " ■ »^ 

Prior to illamination of fiie target with the planar laser iUnmination beam 

(PLIB), modulate the spatial phase of the transmitted PLIB along the planar 
extent tiiereof according to a spatial phase modulation fimction (SPMF) so as 
to * 5 
produce numerous substantially different time-varying speckle-noise 
patterns at the image detection array of the IFD Subsfystem during tiie photo- 
integration time period thereof* ................^--—^^ 


Temporally average fllie numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array In the IFD 
Subsystem durhig the photo-integration time period thereof so as to thereby 
reduce the power of the speckle-nolse pattern observed at the image 
drteetton array. 
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The Second Generalized Stoedde-Noise Patteni Redndioii Method 
Of The Present Invention 

Prior to ffliunmation of the tmi^et ^fh flie planar laser iDnmination beam 
CPLIB)» modulate flie temporal fntraslty of the transmitted PUB along the 
planar extent tihereof according to a temporal intmity modulation function 
(T]MB)soa$to. 

produce numerous substantially different time-varying speclde- 
noise patterns at the image detection array of the IFD Subsystem during the 
photo-integration time period thereofl 

Temporally average the numerous substantiaUy different time*-varying 
spectde-notee patterns produced at the image detection array hi the IFD 
Subsystem durii^ the photo-integration thne p^od thereof so as to Amby 
reduce power of ttt spedde-noise pattern observed at the image detection 
array. 
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Prior to illiiiiiiiiatioii of the target witib the planar laser iUiuninatioii beam 
(P13B), modidate the temporal of the transmitted PLIB aie»g^e 

plMmEbextatsflie^^ j^^^-t moduiafionfimcfioii 

(EPMF) so as to! 

produce nnmeroiis substantially different time^var^ing qieckle* 
noise patterns at tte image detection array of the lED Subsystem during the 
photo-integration time period thereol 


Temporally average the numerous snbstontiaUy different time-varyii^ 
qpeckle^oise pattens produced at the image detection array bt the lED 
Subsystem during the photo-intep-ation time period thereof, so as to thereby 
reduce power of the spedde-noise pattern obsm^ed at the image detection 
array. 
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Goteralized SpecMe^Noise Pattern Redncttoii M ettod 
Of The Present Inventtoit 

Prior to UlnminatiOB of the target ivitih i9ie planar laser fflmnbiafion beam 
^LIB), modtdateAe temporal^ of the tmnsmitted PUB 

according a ^poral intensity modulation fimcfion 

(T J^fF) so as to i 

produce nnmerous snhstantiall^ different time-varjdbotg spedde* 
noise patterns at the image detection array of the IRD Subsystem during fite 
photo4ntegration time period thereof* _ 

TemporaUy average the numerous substantial^ different time-varying 
specMe-noise patterns produced at tiie image detection array in tiie IFD 
Subsystem during the photo-intention time period thereoi^ so as to fh&tthy 
reduce power of the jq>eckle*noise pattern observed at tiie image detection 
array* 
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pf ilM Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 


Prior to illiuniiiatioii of the tai^et with the planar laser fllnmination beam 
(PUB), modulate the qpatial intrasity of the transmitted PLIB along the 
planar extent thereof according to a spatial intensity modulation function 
(SIMF) so as to : 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the IFD Subsystem during the 
photo-integration time period thereof* 


Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in tiie IFD 
Subsystem daring the photo-integration.time period thereof; so as to thereby 
reduce power of tihe speckle-noise pattern observed at the image detection 
array. 








fi^nerallzed f^eckle-N olse Pattern Bednctloii Method 
Of The Present Inventioii 


After iUmnination of fiie target witti the planar laser iilummation beam 
(PLIB), modulate the iqpatial intensity of the reflected/scattered (ie. recdved) 
PLIB along the planar extent thereof according to a spatial intem^ityl 
modulation fimction (SIMP) so as to ; 

produce numerous substantially different time- 
varying speckle-noise patterns at the image detection array of the IFD 
Subsystem during the photo-integration time period fliereol 


Temporally average flie many substantially different ttme^varymg jqpeclde- 
noise patterns produced af the ima^;e detection array in fte IFD Subsystem 
during tiie photo-bitegration time period thereof; so as to thereby reduce the 
speeUe-noisepattmi observed at the image detection array. 
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'^^jwj X Generalized Sneckle-Noise Pattern Reduction Method 
^^"^ — " Of The Present Inventioii 


After illumiiiafiOB of fk€ target ^th the planar laser illoinination beam 
(PLIB), modulate thc^-teitlporal intensity of the reflected/scattered (i.e* 
received) PLIB along the planar extent thereof according to a temporal 
^ intensUy modulation fnnctioil (TIMaP) so as to : 

. produce many substantiaily dllSerent 
time-varying speckle-noise patterns at the image detection array of the IFD 
Subsystem during the photo-int^ation time period thereof. 


1 


Temporally average the many substantially different tinie-varying speckle- 
noise patterns produced at the image detection array In the IFD Subsystem 
during the photo-integration time period thereof^ so ^ to thereby reduce the 
speclde-noise pattmi observed at the image detection array* 



EIGHT GENERALIZED METHOD OF REDUCING THE SPECKLE PATTERN 
NOISE OBSERVED IN PUIM-BASED IMAGING SYSTEMS 


a/1 


Use a PLIIM-BASED Imager to produce a series of consecutively 
captured digital Images of an object over a series of photo-integration 
time periods of the PLIIM-Based Imager, wherein each digital Image of 

the object Includes a substantially different speckle noise pattern 
produced by natural oscillatory micro-motion and/or forced oscillatory 
micro-movementof tiie Imager relative to the object during operation of 
tiie PLIIM-Based Imager. 


B 


Store the series of consecutively captured digital images of the object in 
A buffer memory within the PLIIM-Based Imager, 


Add relatively small (e.g. 3x3) windowed image processing filters to the 

additively combine and average tiie pixel data in the series of 
consecutively cs^ptured digital images so as to produce a reconstructed 
digital image having a speckle noise pattern with reduced BMS power. 


FIG.1I24D 
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NINTH GENERALIZED METHOD OF REDUCING SPECKLE PATTERN 
NOISE IN PLIIM-BASED IMAGING SYSTEMS 


During each photo-integration time period of a PLIIM-Based Imager, 
produce numerous substantially different spatiaiiy-varying speckle noise 
pattern elements (I.e. speckle noise pattern elements at different points) 

on each image detection element in the image detection array of the 

PLIIM-Based imager. 


B 


Spatially (and temporally) average said spatially-varying speckle-noise 
pattern elements over the spatial area of each image detection element, 
y thereby reducing fte RMS power of speckle-pattern noise obsen^ed In 

s^d PLIM-Based Imager. 


FIG. 1 1241 
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Specify object detection and tracking capablBties of PLUM- based network , ^tem, 

and/or subsystem. 


Specify object identification capabilities of PUIM-based networtc , system, and/or 

subsystems. 


B 


I 


Specify object attribute acquisition capabilities of PLllM-based networl<, system, and/ 

or subsystem. 


I Detemiine tiie configuration of hardware components required to build the configured 
xj system or network. 


Determine tlie configuration of software components required to build tlie configured 

system or network. 


The system configuration manager program accesses the determined software 
components from its Software Ubrary {e,g. maintained on an infomiation server within 
the system engineering department), and compiles these software components wifli all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 


G 


The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instmctions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of the necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

ser>ncing. 


\l/ 

Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 

operate and test tiie system for troubles it may experience, and diagnose the same 
wltii or without remote service assistance made available tiirough the remote 

monitoring, configuring, and sen^icing system of tiie present invention, Illustrated in 

Rgs.30Atiirough30D2 


FIG. 10C 









FIG. 13A 


ijj 

ii; 

i 

nj 


FIG. 13A 
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PLLIM-B ASED PACKAGE IDENTIFICATION AND 
DIMENSIONING (PID) SYSTEM 


LDIP Package 
DimsDsiooerwith 


Image Processing Con^^uter 

I 


21 


Attt(>-R)cus/Attti>-2boni 


^3" 


Cameca Cbntrol Coxx^at^ 
Subsystem 

(Bgs,24A.24B, 25,26,27. 
28,29) 


Package 


22 


Real-TmeTackageHei^ 
FrofllifigaiuiEdge* 
Diction Procesdog 


Velocity Module 


0^21,22,23} 


1 11 — '^-<i*wJ 


LDIP Subsystem (122) 


FIG. 14 


LDIP REAL-TIME PACKAGE HEIGHTPROFILE AND 
EDGE DETECnON METHOD 


B — 


C — 
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E — 


Convert raw dam klo noee pnlQe 
R«i£[int {toe], iie&Kn:ed wi^ 
CSaoidioate $ya«em syiribol^^ 
LDiPSiib^stefiL 


UseGeoaettfet 

»R^lsi!i(aii£ - 90) and 
xffl » RGOtan(aiig - 9Q) to coavcrt xaage profile 

into hp] aad posmoa xOQ data. 


Obtain cuireii package kislit by fia^ 
prevailiBg bdgit tising ft^ detection wifliout 
ffitenDg(Bg.lti). 


Hnd the Dooiduates of tiic left and right edges of 
packer (LPE» REE) by searching the closest 
coordinates ftom hedges of the bdtCK^, 
toward die center thetei^ 


LDIP Pacbee Dimeo^Kmer with Intesiated Veloc^ 
Detecdon 


Real-Time Package 
HeiSElitM5fii|gand 
Bdfee Deteciioii 
, ftoees^MoAile 


Analyze inteosi^ data values (R(nt)} and 
d<»eniiioe the X coordtae po^&>aiange TS^ 
Xtf 0B R gtobaO Where die mlnsa^r 
eluHijges 0) wifhin the spoliad boonds 
and ^b^ood piedeteindoedliels|htimens&^ 


Create time-stamped dm set h, Yb. 
nT) by assembUog package left-edge coocdinate 
(U>C^ eonett padbtge (hX patOnge rig^ 
edge CDOidinaie (RF^)^ X coot^nate subcange 
wbete hd^ values esddbit xnaxiiaiim 
cfaangea, package veloci^ (Vb), and time stamp 


Send hextupte data set to camen oontcol 
computer. 


bdtvdo(% 


1^ 


Fig. 15 
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LIOT Real lime Package Edge DetecticMi 



Xa» l06«tamof left c4g^ Xb«locati(m ofW 


LD]QPSubsystan(122) 


Polar Coordinate System 



conveyQrbelt 


GlDbaTCattesian 
Coordinate 
Syst^ 


Fig. 17 


INFORMATION MEASURED AT SCAN ANGLES BEFORE 
COORDINATE TRANSFORMS 


a,=a. 
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h,0, l^&z 

















Fig. 17A 


RANGE AND POLAR ANGLE MEASURES TAKEN AT SCAN 
^^oBH^RECOORDINATETRANSFORMS 


KangeudPolir 


Ri,^ Rm.^« 


Hg.l7B 


MBASURH) PACKAGE HEIGHT AND POSITION VALUES 
AFTERCOORDINATETRANSFORMS 


HH 

coordinate tnmsfcxms 


(x.y)«. 



X(02) 
hd^t value y(Oi) and 
position vdue 3((aj) 
tseasuied ttMt belt edge 


Fig. 17C 


CAMERA CONTROL PROCESS CARRIED OUT WITHIN THE CAMERA 
CONTROL SUBSYSTEM OF EACH OBJECT IDENTIFICATION AND 
ATTRIBUTE ACQUISITION SYSTEM OF PRESENT INVENTION 

Start 


i 


B' 


Camera Control Computer receives a tima-stamped quintuple Data Set (U. coordinate 
of Left Package Edge, coordinate of Right Package Edge, height, velocity, and time 
stamp) from the LDJP Subsystem and stores the Data Set in a Package Data Buffer 
Structure having N^S columns and M rows; Camera Control Computer optical power 

(mifliwatts) whteh each PLIA must produce (using method in Rgs. 18C), and transmits 
the computer opticai power to each PLSA and dependent system* 

A — ] 





r 


Camera Control Computer analyzes height data in the Package Data Buffer and detects 
the occurrence of detecting discontinuities, and based on such detected height 
discontinuities, determines the con^sponding coonjinate position of the leading 
package edges by left-most and right-most coordinate values associated with the data 
set at this detected h^ght discontinuity. 

(5) 


0^ 


Camera Control Corr^utsr determines the height of ^e package 
associated with the leadng pacl<age edges detemiined at Block B above. 


N, 


Camera Control 
Computer transforms 
the position of left and 
right package edge 
(LPE, RPE) coordinates 
buffered in the deepest 
row of the Data Package 
Buffer at which the 
height value was 
determined at Block D 
to a Qtobai Coordinate 

Reference System 
symbolically embedded 
in the conveyor belt 
structure beneath the 
UDIP Subsystem, as 
^wn in Ffg. 17. 


D. 


Camera Control Computer 
suialyzes the height values 
(i,e. coordinates) computed 
over previous raw data set 

processing cycles, and 
stCH-ed In the Package Data 
Buffer, and detennlnes the 
"median* height of 
package, as well as the 
average "slope" of the 
package's taser scanned 


1 


A 


Camera Control 
Computer analyzes 
h^ght value In the 
Package Data 

Buffer, and 
detennines the 
speed of ^e 
package (Vj,(t)). 


(3) ® © 


FIG. 18A 


® 


0 


1 


Camera Control Con^xiter detects the x- 
coondlnates of the padcage boimdarles based 
on the spattaOy^transfoimed ooordinate values 
of tie ielt and ^ht package edges (LPS, 
BPE) buff^ in the Padfflge Data Buffer. 


I 


Based on x-^oorcfinates of the detected 
package boundaries (and optionally, the 
subrange of x-coordlnates over which 
maximum range "fntensfty* data variations 
have been detected by me (ens data of Fig. 
15) detennined at block 0, the Camera 
Conm>I Computer detennines the 
corresponding pixel indices (i, j) in the Image 
Buffer whid) specify the image frame (i«e. 
region of interest) to be cropped from ^e 
imag6(s) to be subsequently captured by the 
if=D Subsystem. 


Camera Control Computer uses Focus/Zoom 

Lookiq;) Table in Fig. 21 to detennine the 
focus and zoom lens gro^> positions based 
on the height of me package detemf)ined at 
blocka 


Camera Control Computer transmits Lens 
Group Moves Commands to the iFD 
Subsystem. 


IF^ Subsystem uses the Lens Qpotiq? 
Movement Commands to move the lens 
groups to th^r desired po^ons. 


H 


T 


Camera Control Computer checks 

resulting positions of moved lens 
groups* 


Camera Control Computer con-ects lens 
group positions. 



Camera Control Computer uses the 
computed values of median package height, 
belt speed and the Photo-lntegratkm Time 
Lookup Table In Ffg. 23 to detemiine the 
photo-ftitegraflon Hme parameter whk:h will 

ensure that "square" image pixels are 
produced in capfetred package images (i.e. 
pixels havmg a 1:1 ratio); Camera Control 
Computer also uses (0 computed belt speed/ 
vek>dty, (ii) thepre-specified image resolution 
(dpi), and (ill) computed "slope" of laser 
scanned surface so as to compute the 
surface-^ope compensated Une Rate of the 
IFD subsystem that helps misure that 
captured linear Images have substantially 
constant pixel resolution (dpi) independent of 

the angular anangement of the package 
surface during surface profSIng and imaging 
operations. 


Camera Control Computer generates digital 
control signsds for the compute parameters- 
Photo-Integration Time Period and 
Compensated Line Rate- and thereafter 
transmrte these digital control signals (o me 
CCD image detection aimy an the IR) 
Subsystem* 


Camera Control Comp^x uses package 
time^tamp (nT) and pec^ge veloct^ (V ) to 
detennine the *^ait Time" of Image Frame 
Caq3mre(STIC) 


Camera Control Computer uses (i) me Start 
Time of Image Capture (STIC) detennined at 
Block Qp to generate a command for starting 
Ima^ Frame Capture, and ^ uses (11) the 
pixel Indices (l,J) detemiined at Block P to 
generate commands for cropping me 
conesponding sBce of me "region of interest" 
in the image being capUired and buffered in 
me Image Bufterwimin me IFD Subsystem. 


Camera Control Computer transmite me 
coffunand generated at Block R to the IFD 
Subsystem. 


FIG. 18B 


METHOD OF COMPUTING OPTICAL OUTPUT POWER FROM CASE 
PIQDgg IN PLANAR USER IIUM1NAT!QN ARRAY (PLIA) FQB 
CONTROLLING C ONSTANT WHITE LEVEL IN IMAGE PIXELS CAPTURED 
BY pi,l|M-BA$ED MNSAP IMAQER 


Compute the Line Rate of Linear Image Detection Array (dots/sec) 
based on computed Belt Velocity (Inches/sec) and constant Image 
^ Resolution (dots/lnch) desired, using equation: 

Line Rate = (Belt Velocity) x (image Resolution) 


Compute the Photointegration Time ^ of the Linear Image 
Detection Array based on the computed Line Rate using the 

formula: 


Photointegration Time Period s 1/Line Rate 


0 


FIG. 1801 


0 


Compute the Optical Power (milliwatts) of each PLIA based on computed 
Photointegration Time Period (AT) using the f oBov\rfng formula: 


Optical Power of VLD {milllwatls) = 


constant 


Photointegration Time Period AT 


FIG. 18C2 


METHOD OF COMPUTING COMPENSATED LINE RATE FOR CORRECTING 
VIEWING-ANGLE DISTORTION OCCURING IN IMAGES OF OBJECT 
SURFACES CAPTURED AS OBJECT SURFACES MOVE PAST PLUM- 
PAggP ilNPAR IMAGER AT NON-ZSRQ SKKWSQ ANQlg 


Compute the Line Rate of Linear Image, Image Detection An'ay 
(dots/sec) based on computed Belt Veiodty (indies/sec) and 
constant image Resolution (do^nch) desired, using equation: 

Line Rate - (Belt Velocity) x (Image Resolution) 


Compute the Line Rate Compensation factor cosine (6 or 0), where 
8 and 0 is defined in Figs. 18E1 and 18E2 respectively as the 

computed average scope of the packages surface laser scanned by 
the AM laser beams powered by the LDIP subsystem, and is 

computed at Block D in Fig. 18A. 


Compute the Compensated Line Rate for the IFD (i.e. camera) 
subsystem using the equation: 

Compensated Une Rate = (Line Rate) x Cos(e)) 


FIG. 18D 


CASE1: 

Top Down Imaging 


AM Laser Beams 


CoplanarPUB/FOV 
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X coordinate subrange whete 
mwdmoin range **intenaHy^ 
variations have been detected 


Left Package j 


Package Height (H) Edqe(RPE) 


Righ t Package Package,, ^ j . j:ime-starn£ 


Velocity 


(nT) 


Rowl 
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Rows 


RowM 


Package Data Buffer (FIFO) 

FigJ^ 
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Columns 



Rows 


Camera IHxel DataBufi^ 
pixellndioes (ilj,) 


Fig- 20 
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1^1 

METHOD OF A ND APPARATUS FOR PERFORMING AUTOMATIC 
RECOGNITION OF GRAPHICAL INTELLIGENCE CONTAINED IN 2-D 
IMAGES CAPTU RED FROM ARBITARY 3-D OBJECT SURFACES 


STEP 1 : At the unitary PLllM-based object imaging and profiling system, 
use the laser doppler imaging and profiling (LDIP) subsystem employed 
therein to (i) consecutively capture a series of linear 3-D surface profile 
maps on a targeted arbitrary (e.g, non-planar or planar) 3-D object 
surface bearing forms of graphical intelligence and (ii) measure the 
velocity of the arbitrary 3-D object surface, wherein the polar coordinates 
of each point in the captured linear 3-D surface profile map are specified 
In a local polar coordinate system RuDip/poiar» symbolically embedded 
Vkrithin the LDtP subsystem. 


I 


STEP 2: At the unitary PLIIM-based object imaging and profiling system, 
use coordinate transfomns to automatically convert the polar coordinates 
of each point p(a, R) in the captured linear 3-D surface profile map into 
x,y, z Cartesian coorxiinates specified as p(x,y,z) in a local Cartesian 
coordinate system RLDipycartesiam symbolically embedded v^ittiin the LDIP 
subsystem. 


STEP 3: At the unitary PLIIM-based object imaging and profiling system, 
use the PLIIM-based imager employed therein to consecutively capture 
high-resolution linear 2-D images of the arbitrary 3-D object surface 
bearing fomis of graphical intelligence (e.g. symbol character strings), 
wherein (i) the x", i coordinates of each pixel in each said captured high- 
resolution linear 2-D image is specified in local Cartesian coordinate 
system R puiM/cartesfan symbolically embedded within the PLIIM-based 
imager, and {11) tfie intensity value of the pixel Kx^.y*) is associated with the 
x', y* Cartesian coordinates of the image detection element in the linear 
image detection array at which the pixel is detected, and (iii) wherein also 
the planar laser illumination beam (PLIB) of the PLIIM-based imager is 
spaced from the amplitude modulated (^) laser scanning beam of the 
LDIP subsystem is about D centimeters. 



FIG. 23C1 


? 


STEP 4: At the unitary PLIIM-based object imaging and profiling system, 
capture and buffer the camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the corresponding 
photo-Integration time peifod ATk, by the PLllM-b^d Imager 


STEP 5: At tiie end of each photo-integration time period ATk, use the 
unitary PLIIM-based object imaging and profiling system to transmit the 
following information elements to the Image Processing Computer for 
data storage and subsequent infomiation processing: 

(1) the converted coordinates x, y, z, of each point In the linear 3- 
D surface profile map of the arbitrary 3-D object surface captured during 
photo-integration time period ATk; 

(2) the measured velocity(les) of flie arbitrary 3-D object surface 
during photo-integration time period ATk; 

(3) the x*, y* coordinates and Intensity value Kx\y*) of each pixel in 
each high- resolution linear 2-D Image captured during photo-integration 
time period DTk and specified in the local Cartesian coordinate system 

'^PLIMCarteslan ^ 

(4) the captured camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the photo- 
integration time period ATk 


STEP 6: At ttie Image Proces^ng Computer, receive the data elements 
transmitted from the PLIIM-based profiling and imaging system durin Step 
5, buffer data elements (1) and (2) in a first FIFO buffer memory structure, 
and data elements (3) and (4) in a second FIFO buffer memory structure. 


1 


FIG. 2302 
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STEP 7: At the Image Processing Computer, use the x,y, z coordinates 
associated with a consecutively captured series of linear 3-D surface 
profile maps (i.e. stored in first FIFO memory storage sfructure)in order to 
construct a 3-D polygon-mesh surface representation of said arbitrary 3-D 
object surface, represented by SLDip(x,y,z) and having (i) vertices 
specified by x,y, z in local coordinate reference system RpuiM/cartesian , and 
(II) planar polygon surface patches Sj(x,y,z) and being defined by a set of 
said vertices. 


STEP 8: At flie Image Processing Computer, convert the x'y,2* 
coordinates of each vertex in the S-D polygon-mesh surface 
representation into tine local Cartesian coordinate reference system 
R PLiiM/cartesian Symbolically embedded vwtiiln the PLIIM-based imager. 


STEP 9: At the Image Processing Computer, specify the x',y , i 
coordinates of each i-th planar polygon surface patch s{x,y,z) represented 
In the tooai Cartesian coordinate reference system RpuiM^artestan' so as to 
produce a set of corresponding polygcm surface paldi {siCx*,/,!*)} 
represented in system RpuiM/canesian 


I 


STEP 10: At the Image Processing Computer, for a selected linear high- 
resolution 2-D image captured at photo-integration time period ATk* and 
spatially corresponding to one of the linear 3-D surface profile maps 
employed at Step 7, use the camera (IFD) parameters used and recorded 
(i.e. captured) during tiie corresponding photo-integration time period in 
order to constmct a 3-D vector-based "pixel ray" model specifying the 
optical fomiation of each pixel in the linear 2-D image, wherein a pbcel ray 
reflected off a point on the ari^itrary 3-D object surface Is focused through 
the camera's Image formation optics (i.e. configured by ttie camera 
parameters) and Is detected at the pixel's detection element in tiie linear 
image detection anray of the IFD (camera) subsystem. 


FIG. 23C3 


i 


STEP 1 1 : At the Image Processing Computer, for each laser beam ray 
(producing one of the pixels in said selected linear 2-D image), (i) 
detemiine which polygon surface patch S|{x, y, z) the pixel ray intersects, 
(ii) compute the x,y, z coordinates of the point of intersection (POI) 
between the pixel ray and the polygon surface patch represented in 
Cartesian coordinate reference system RpuiM/cartesian i 0") designate 
the computed set of points of intersection as {Pj(x,y,2)}. 


-8TEP 12: At fte Image Processing Computer, for each laser beam ray 
passing through a detemriined polygon surface patch sCx',^, z') at a 
computed point of Intersection p.(x, y, z), assign the intensity value l{x*,y') 
of the pixel ray to fte x\ y', z* coordinates of the point of intersection, I^l 
thereby producing a linear high-resolution 3-D image comprising a 2-D ^ 
array of pixels, each said pixel pixel having as its attributes (I) an Intensity 
value l(x\y*,z*) and (11) coordinates x\ y*, t specified in the local Cartesian 
coordinate reference system RpuiM^janesian • 


STEP 13: Put the computed linear high-resolution 3-D image in a third .^^-^ 
FIFO memory storage structure in the image processing computer. 


STEP 1 4: Repeat Steps 1 -6 to update ttie first and second FIFO data 
queues maintained In the image processing computer, and Steps 7-13 to j^N 
update the consecutively computed linear high-resolution 3-D image 
stored in the third FIFO memory storage slnjcture. 


STEP 15: ^emble in an Image buffer in the image processing 
computer, a set of consecutively computed linear high-resolution 3-D 
images reWeved from the third FIFO data storage device so as to LX) 
construct an "area-type" high-resolution 3-D image of said arbitrary 3-D 
object surface. 


FIG. 23C4 
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STEP 16: At the Image Processing Computer, map the Intensity value 
l(x', y , t) of each pixel in the computed area-type 3-D image onto the 
x'j/jZ' coordinates of the points on a uniformly-spaced apart "grid" 
positioned perpendicular to the optical axis of the camera subsystem (i.e. 
to model ttie 2-0 planar substrate on which the fonms of graphical 
intelligence was originally rendered), wherein said mapping process 
involves using an intensity weighing function based on the x*, y, t 
coordinate values of each pixel in the area-type high-resolution 3-D 
Image, thereby producing an area-type high-resolution 2-D Image of the 
2-D planar substrate surface bearing said fonns of graphical intelligence 
(e.g. symbol character strings). 


STEP 17: At ttie Image Processing Computer, use said OCR algoritiim to 
perform automated recognition of graphical intelligence contained In said 
area-type high-resolution 2-D image of said 2-D planar substrate surface 
so as to recognize said graphical intelligence and generate symbolic 
knowledge stmctures representative thereof. 


STEP 18: Repeat Steps 1-17 as often as required to recognize changes 
in gr^^hicai intelligence on tiie ari^itrary moving 3-D object surface. 


FIG. 23C5 
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Specify object detection and tracking capabilities of PLUM- based networic , system, 

and/or subsystem. 


Specify object identification capabilities of PLIIM-based network , system, and/or 

subsystems. 


I 


Specify object attribute acquisition capabilities of PLIIM-ttased networic, system, and/ 

or subsystem. 



Detemnine tlie configuration of hardware components required to build tfie configured 

system ornetwork. 


f 

Determine the configuration of software components required to build the configured 

system or network. 

N 

f 

The system configuration manager program accesses the detemiined software 
components from its Software Library (e.g. maintained on an infonnation server within 
the system engineering department), and compiles these so^are components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 




The systems configuration manager program automatically generates an easy-to- 
follow set ctf Installation Instmctions for the configured system or network, guiding the 
technician through an easy to follow installafion and set-up procedures making sure all 
of the necessary system €Uid subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

servicing. 


Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may expedence, and diagnose the same 
y with or without remote sen/ice assistance made available through the remote 
H monltoHng, configuring, and servicing system of the present lnventk)n, illustrated in 

Figs. 30A through 30D2 
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Use an Internet-enabled client computer to establish a network 
connecBon (via network router) with an HTTP server in tiie tunnel- 
based LAN requiring remote monitoring, control and/or service. 


'ill 

W 


ill 
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Use an Internet-enabled client computer to access an RMCS 
management console (GUI) from the HTTP server and display the 


same. 


Use the RMCS management console to display network 
configuratk>n parameters in the tunnel-based LAN, and to use these 
network configuration parameters to monitor configuration 
parameters smd perfbmianoe parameters of each s^em in the 

network. 


Use the RMCS management console to monitor the configuration 
and c^her monitorable parameters of eadi subsystem In the system. 


Use ttie RMCS management console to run a diagnostic program to 
trouble shoot any perfomnance problems with the system. 


Using infomiation collected by the diagnostic program and the 
RCMS management console, reconfigure selected parameters in 
the system and instruct any hardware repairs that may be required 

at the LAN location. 


FIG. 30D1 * 


Use the RMCS management console to rerun diagnostic programs 
on troubled systems and subsystems in the LAN after parameter 
reconfiguration and/or hardware repair at the LAN location, so as to 
test the perfomoance of such systems and subsystems and the 
overall binnel based LAN. 


Use the RMCS management console to monitor parameters of the 
system and subsystems in the tunnel based LAN, from time to time, 
to detennlne whether or not the system 
and/or netwotlc tunnel is required. 


Use the RMCS management console to record all monitc^ed 
parameter records and result of diagnt^lc programs in a customer 
service database for future reference, and access during 
subsequent remote service calls over the Intemet. 


FIG. 30D2 



For each package ttansportBd througb turmel syst^ master unit (wi& package diin&nsioning 
snbsystm and vdoci^ detedion subsystein) generates pickage hei^t, widtl^ lengtit and 
velocicy data {H,WJ^V}q, tdimiced with tes^to gidbal cooidtoate refmnoe system 
Rgiottti* ^ transmits such package dtznension<kta to eadi slave unit dovmstr^^ u^gthe 
^ystm*s dam ccmmHinications setwori^ 


I 

Each slav»umt]ficeives the transmitted paok^li^^wi^ {liWJUV}^ 
and conv^ &is coon&ate uESoniuilioii into the slave unit's local coordmate r^enoe ^stem 


The oamefa control con^>uter in each slave unit uses tlie ccmv^ted package hdgh^ widtti« 
lengfli data {H»WJL}i and padcage velodty data to generate camera control signals for driving 
the canaera subsystem in the slave unit to zoomand focus in on the transported pai^e as it 
moves by the slave unit, while ensuring that captoied inaaj^ having substantiafiy constant 
OJ*X Besohitionand 1:1 aspect ratio* 


Ha32A 


i 


Each ^av& usit captuces images acquked by its intdl^tly coiirolled camm subsystem^ 
in said images* aiid/br topetform opcisal diaracter zecogmtioa (OCR) &ereopoiu 




The slave umt wMch decodes abar code symbol In a pn)cessed anage automaticaSy transnits 
a package identifi^atioii data eleaiem (contaming symbol character data is^ttesentatiye of ^ 
deco4ed bar code symboD to the master uoit {ot o&er designa^ system c(mtxo\ xaai 
es^loyiEtg data efemoit ma&agementfimcdonalides) for packagedata efem^t processing. 


I 

Master udttime>siamps teceired padcage identil^tion data element, pla^ said data 
element m a data queue, and processes package ide&tificadcm data elements and tims-stamped 
ps^gb dlm^on data elements in said qii^oe to Hnkeadi package identification <kta 
element with onesdd conespoodlng padb^ ^menuon data tiBment 
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Bach passenger who is about to board an aircraft at an airport, would first go to 
check-in statbn with personal ideniiilcatioD (e.g. passport, ddvers license, national 
identification card, etc.) m hand, as well as with aiticles of baggage to be carried oa 
boatd Hie ancraft by the passenger. 


XJjpon checking in wiUi this statbn, ^ Passenger Iden^cation (PID) Bar Code 
Symbol And Bs^age Identification (BID) Bar Code Symbol Dispensing Subsystem 
tssmes (1) a passeni^ identification bracelet bearing (or otherw^ «»K>ded with) a 
PID bar code syn^l and (2)acones{K)ndlignDbar^ 
ea(^paid»ge carried on&caiteiaftl^ the passen^. At the same tus^ tins 
sub^stem creates, f<Mr ea^ passenger and set of baggage diedced kkio die syM& at 
the check-In station, a pass^gen/bstggag^ infonnafionrecoid in the Passei^and 
B^gage Atti97iite RDBMS. 


1 

r 

The passrager identification (PID) bracelet (or identiScation badge) is a£5xed to the 
passenger s person at the passenger check-in station which is to be worn during He 
entire ducation of tiie passenger 5 sdieduled flight. 

1 

f 


The PLOM-Based Passenger Identification And ProfUiE^ Camera Subsystem at the 
passenger check-in station automatically captures a digital of the 
passenger s &ce, head and upper ho&f, (ii) a digital profile of his or her &ce and head 
(and possib]^ body) oangdie LDIP sub^tem employed thereiii^ and (iii) a digital 
image of the pass^gers identification card(s). Other biometric information 
acquisition devices provided at ^e passenger check-m station can be used to acquire* 
fiom eadi passenger checking-in, passenger attribute information (e^g. retinal pattern 
mfoimation. fk^erpimt pattern infcumatioxt voice patient iotonaticuu ^tcial pattern 
infoimafson, DNA pattern informatiQn) to assist in tiie idiabk identifu»tli»iof ti^ 
passenger. 


Each iten of passenger attdbute informatfon acquired at the passenger check-in 
station is co-indexed witii the corresponding passenger identiScatton (PID) number, 
and stored in tbs information records maintained m the Passenger and Baggage 
Attribute RDBMS, subsequent information processing* 
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Eadi BE) bar coded article of baggage b conv^ed through the tunnel-type package 
identlficatioo» dimeisioiuag and tiackiiig subsystem isstalled before ^ eotiy port of 
the X-racfiattoQ baggage scanning si^)system (or integrated teiewifiun), and is Uien 
c(xiveyedthioug$itheX-radiatbnbag^gescaimmgsid)S^^ As this scaomng 
process occurs, each bar coded articb of baggie is automaticaliy ul^tijSed, imaged, 
and dimensioned/pioftledby package identification, dimensioning and tracking 
subsystem and then imaged by x-radiation scamdng subsystem. 



r 

Eadh item of baggage attribute information acquired at the bagg^ check-in statkm is 
coi&dexed wilh the corresponding baggage identification (BID) numbeft and stored 
in &e information records maintamed in die Passengorand Baggage Attribute 
RDBMS, subsequent infonnationproces^g. 


r 

Each BID bar coded article of b^gage is convoked tihrough a second {unn?l*type 
package identification, dimensioning and trackkig subsystem installed downstream^ 
before the entiy port of &e automated explosive detection sub^stem EDS (or 
integmted therewitibin), and is fben conveyed thiougji the EDS. 


f ' 

At the EDS station, each bar coded article of baggage is automatically^ identified, 
un8ged» and dimensioned^ofiled by package ideatification» dim^isioQing and 
tracking sub^/stem and dien ana^d by EDS. 


r 

Eadi ilem of baggage attribute information ac^iired at tbd EDS station is co- 
ind^ed witfithe conespondiflg baggage id^ficat2<m OBID) nuoiber, a^ 
the information records maintained in the Passenger and Baggage Atdibute 
RDBMS, subsequent infonnatbn processing. 


flQi.BBpZ. 


Conventional methods of detecting suspicious condidons reveated by x-ray images of 
baggage can be used (e.g. using an x-ray image monitor adjacent ^ x*ray scannhg 
subsystem) 


bieil^ent tnfonnatioii ptocessiag algoritfams caabe used to auiomatlcaify operate on 

i wcotd stored in &e Passenger and Bagpge 


N 


AfinboleRDBMS 


Passenger attr3>ute infoiroation stored in remote intelligence RDBMSs can be 
accessed and used with passenger and baggage attribute information in the Passenger 
M — I and Ba^ge Attribute RDBMS in order to detect any suspidktttsccmditionsw^ 

may gxven concern en: alarm about either a particular passenger or artide of bs^ggage 
presenting concern or a breach of security* 


Such post-check-in infonnation processing operations can also be carried out on 
passenger and/or baggage attcibute infonnation stored m the Passenger and Atti^ute 
RDBMS and/or m remote isteiligence RDBMSs on a wide aiea netwoiic (WAN) or 
local area netwodc (LAN) with hitman assistance, if necessary, to detennine if a 
breach of security appeals to have occurred. 


If a breach is determined pnor to flight-time, &en ttc flight related to the su^>ect 
passenger and/or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a bteach is detected after an aircraft has lifted off, then &e 
flight cxew and pilot can be infinmed by radio oommvnicatbnof (he detected 
security concern. 



Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal Idei^ficatioA (e.g. passport, drivers license, national 
identification card» etc.) in land* as well as with aitides of baggage to be carried on 
bo^d the aircraft by the passenger. 


111 


B 


Upon checking in with ttas sta^ fl» Passenger Identification (PID) Bar Code 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identi6cati<m bracelet bearing (or otherwise encoded with) a 
PID bar code symboL and (2) a corresponding PID bar code symbol for attadunent to 
each package carried on the avcmft by the passenger. At the same time, this 
siib^stem creates, for each passenger and set of baggage checked into &e system at 
the check-in station, a pass^get/bagga^ information record in the Passenger and 
Baggage Attribute RDBMS. 



f 

The passenger identification (PID) bracelet (or identification badge) is afi^bced to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire dtsfttion of the pass^ger s schedoled flight. 


f 


The PLHM-Based Passei^ Idenfificatbn And Profiling Camera Subsystem at the 
passenger check-in station automadcally captures (i) a digiM image of tiie 
passenger s face, head and upp^ body, (ii) a digital piofile of his or her &ce and head 
(and possibly body) using tfie IDIP sub^ratem employed therem, and (iii) a digital 
image of the passenger s identification card(s). Oto biometric informa^n 
acquisition devices provided at the passenger cbeck-m station can be used to acqfuire, 
firom each passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern informatioa, voice pattern mforraation, facial pattern 
informatbn, DNA pattern information) to assist in the jeliable identification of the 


Each item of passenger attribute mfotmation acquired at the passenger check-in 
station is co-indexed with ths corresponding passenger identification (PID) number, 
and stored in the information records maintained in tbe Passenger and Bag^ge 
Attribute ROBMS» subsequent information processii^.. 


F — 

Each BID bar coded article of baggage 1$ conveyed thzoogfa the tunoel-type package 
identification, dimemiotung and tiacking sub^stm installed before ihe entry port of 
the X*iadiatiOA baggage scanning sobsystem (or integrated theiewithin), and is then 
convQred dm»igh the X-radiatk>o baggage scanning subsystem. As thL» scanning 
process occurs, each bar coded article of baggage is automaticallty identifiedt magfid, 
and <!&neastoned/psofiledby package identificatioQ, dimcimoiiingand tiacking 
st^stem and Usen ixnaged by x-racfiatbD scannmg subsystem* 



r 

G — 

Eadi item of baggage attribute information acquired at the baggage check-in statbn is 
co-indexed with the corresponding baggage identification (BID) number^ aixl stored 
m tie information records maintaaied in the Passenger and Baggage Attribute 
RDBMS, subseqo^ infinmatkm processing. 



r 

H — 

Each BID bar coded article of baggage is conveyed thix^ugha second tunnel-type 
package identification^ dhnensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated dierewidiin), and is then conveyed thiough the EDS. 




I — 

At the EDS station, each bar coded article of baggage is automatically identified, 
unaged, and dimensfoned/profiled by padcage identification* danmiomag and 
tracking subsystem and then anal^d by EDS. 



f 

J — 

Each item of baggage attribute informadon acquired at the EDS station is co- 
indexed with^ corresponding baggage identification (BID) nusoben aiKl stored in 
the information lecoids m^iained in the Passenger and Baggage Attribute 
RDBMS, subsequent in&miatbn processing. 


ConvKitiooal meawds of detecting suspicious conditiwjs reveded l>y x-ay images of 
baggage can be used (eg. using an x-ray image moiutor adjacqit fee x-ray scannbg 
subsystem) — 


Intelligent inlbnnatioa processing algorithms canbe us«i to autoiMtically operate on 
each passenger and baggage attnbute recoid stored tn^e Piissenger and Ba^^ 
Attribute RDBMS 


Passenger attribute infonnarion stoted ki temote idselligence RDBMSs canbe 
accessed and used with passenger and baggage attribute information in the Passenger 
and Baggage Attribute RDBMS in order to detect any suspicious owiditions whwA 
may given concern or alarm about ei&er a particular passenger or article of baggage 
presenting concern or a breach of security. 


Such post-check-in infonnationprocessing operations canalso be earned out on 
passenger and/or baggage attribute bfomiadoa stored in Ae Passenger and Attribute 
RDBMS and/or m remote htelligcnce RDBMSs on a wide aiea nctworic (WAN) m 
local area networit (LAN) with human assistattcCi if nccessaxy, to (fetenxnne a 
breach ofsecurity appears to have occurred* ^ 


If a breach is determmed prior to flighl-time, fcen de flight lelated to the suspect 
passenger and/or baggage m^t be aborted with the use of security perwnnel 
signaled by subsystem. If a breach is detected afler an aircraft has lifted off. then the 
flight oiew and pilot canbe informed by radio communication of the detected 
security concern. , 
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